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COMPUTER-AUTOMATED IMPLEMENTATION OF USER-DEFINABLE 
DECISION RULES FOR MEDICAL DIAGNOSTIC OR SCREENING 
INTERPRETATIONS 

RELATED APPLICATION 

[0001] This application is a division of Application No. 09/044,487, filed March 1 9, 1 998, 
which claims the benefit of U. S. Provisional Application No. 60/041,420, filed March 20, 
1997, the entire disclosure of which is incorporated herein by reference. 

TECHNICAL FIELD OF THE INVENTION 

[0002] The present invention relates in general to computer software for providing an 
analysis of electrical test data, and more particularly to software in which professionals can 
tailor the processing of the test data according to their choices, thereby allowing a 
nonprofessional to operate the software and achieve the benefit of the professional's 
judgment. 

BACKGROUND OF THE INVENTION 

[0003] Many types of diagnoses by physicians and other professionals require specialized 
interpretations. This often requires the presence and participation of the professional each 
time a diagnosis is made. In many instances, if the test results of a patient appear to be 
insufficient to make a diagnosis, the patent must return to the hospital or clinic to be retested. 
This is time consuming, aggravating and costly to the health care field. 

[0004] A need therefore exists for a method of allowing a nonprofessional to obtain client 
data and process the data through software tailored by a professional, thereby obtaining a 
professional analysis while utilizing the services of a nonprofessional. 
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SUMMARY OF THE INVENTION 



[0005] Disclosed is a method and a technique for allowing a nonprofessional to utilize 
professional-tailored software to carry out an analysis without the professional being present. 
In the preferred embodiment, a decision tree is provided having multiple levels of analysis, 
where each level includes plural rules for optional use. Each rule is selectable for use by the 
professional, and if selected, the rule has provisions for allowing the professional to assign a 
numerical value for comparison with the client data. In the preferred embodiment, the 
professional can enter into the levels of the decision tree how many of the selected rules must 
pass or fail before the level is considered as a pass or fail condition. Also, provisions are 

^ made in the software to provide a "refer" output, where the test results are indeterminate and 

|| the patient must be tested again while yet present at the test facility. 



[0006] A nonprofessional can attend to all the patent testing to obtain medical data from the 
O patient - in the form of digital data. The nonprofessional can then apply the digital data test 
3 results of the patient to the software decision tree. Since the rules of the software decision 

^ tree were tailored by the professional, the output of the software represents a professional 

£3 analysis that was obtained by a nonprofessional. 

H 
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fy BRIEF DESCRIPTION OF THE DRAWINGS 

[0007] Fig. 1 illustrates the three elements according to the preferred embodiment of the 
invention; 

Fig. 2 is a flowchart illustrating the utilization of the user rules of the computer software 
according to the preferred embodiment; 

Fig. 3 is a flowchart illustrating the application of the rules established according to the Fig. 2 
flowchart; 

Fig. 4 illustrates the sequence of events for utilization of the invention according to the 
preferred embodiment; 
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Fig. 5 is a detailed diagram of the analysis decision tree shown generally as Block 4 of Fig. 2; 
Figs. 6-10 illustrate the respective five levels of the interpretive tree, and the various rules 
selectable by the professional in each level; 

Fig. 1 1 represents the software code in the utilization of the invention, where the user rules 
are retrieved and applied to the classification; 
Fig. 12 is an example of a results report; 

Figs. 13-15 are exemplary printed reports in the form of letters that provide detailed 
descriptions of the patient analysis according to the invention. 

[0008] The purpose of an ever vigilant assistant (EVA software), hereinafter referred to as 
"EVA," is to leverage the expertise of the professional, be it a physician, audiologist, therapist 
or scientist, to use and leverage their expertise to provide an interpretation for a technician 
CO level person to complete particular tasks. To that end, EVA functions as an interpretive 
i A assistant to the professional. For example, EVA is used to provide an automatic interpretation 
j=f of an auditory brain stem response to evaluate the neurologic status of a patient. EVA can 

a provide an interpretation for an otoacoustic emission to let a technician know whether a 

£2 

i'7s particular test conducted on an infant or an adult was a good quality test and what the result 
P was. At this point EVA can be used certainly for specific interpretations of auditory function, 
p but can also be used, for example, in an interpretation of sonograms, of electrocardiograms, of 
i u any kind of diagnostic assessment or screening assessment that requires a professional to 

interpret the test and provide the result. The advantage of EVA is that it allows the individual 
professional to utilize their own criteria as to what is considered a pass or a fail, or what is a 
test in which they would want additional information. It is the professional, the physician 
again, the professional's rules that are applied in EVA. If, for example, there were two 
different laboratories with two different physicians who had two different views of what was 
significant in a sonogram of an infant, each of those physicians could utilize EVA to put in 
his/her own rules so that his own rules would be the ones that applied in the case of their 
interpretation for a patient. In other words, it is the ever vigilant backup to reduce errors, to 
be right there - using the physician's expertise at the time the test is done without needing the 
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professional to be present. And again, if two different physicians in two different laboratories 
in two different places in the country had different interpretive criteria, they can take the 
technology and apply their own rules so that the laboratory presents their view. This is what 
EVA embodies. 

[0009] The input to EVA can be a number of different measures, sonograms, waveforms, it 
could be waveform morphology interpretation. It could be computerized or electronically 
generated. It could be specific numbers that are taken from a computer or from a computer 
generated test. EVA would read the data file, read the absolute values in the data files and 
extract those values and then look for features that would produce the rules. If one is 
y. monitoring a brain function, EVA would pull out the amplitude criteria of the waveform that 
^ was generated from the brain, EVA would pull out frequency characteristics. EVA would 
CO extract information from a wave emission picked up from an amplifier in the ear canal and it 
hi would evaluate features from that emission. Physiologic data from different systems could be 

b 



assessed. EVA would take the representation and then pull out the key pieces that the 
professional chose to call important. It is not an interpretation, but it is the expert's view of 



y the test procedure, to leverage his expertise, to allow him or her to do more. 



[001 0] In Figure 1 , the first focus is to establish the features that will be used in defining the 
rules for evaluating a particular test, diagnostic procedure, or screening measure. In Block 1, 
the technology specific electronic representation is the first feature that needs to be 
considered. This might be the specific embodiment of the IL088, transient otoacoustic 
emission technology by (OAE) Otodynamics London. The electronic representation might be 
waveform analysis or might be a waveform drawn from a particular company's EEG 
equipment. It might take the Grason Stadler GSI60 distortion product otoacoustic emission 
waveform manufactured by Grason Stadler, and apply the same kinds of rules to that. It 
could take Bio-Logics distortion product equipment manufactured by Bio-Logics in 
Mundelein, Illinois, and apply a professional's criteria to that electrodiagnostic equipment as 
well. EVA might take an EKG and pull out data therefrom. The data is taken from the 
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technology (Block 1) and incorporated into a PC based computer running under Windows. In 
the preferred embodiment, EVA is written in Borland's C++ programming language. 

[0011] For example, when an OAE test is completed, a probe is placed in an infant's ear and 
a stimulus is presented to the baby's ear (a sound, a click). An amplifier is attached in the 
probe assembly picks up the emission from the cochlea of the infant ear, and feeds that back 
into the computer into the technology specific application where features are displayed. 
Among the features are the stimulus level, the noise level, the number of quiet and noisy 
stimuli presented, the background noise level, the amplitude of the various components in the 
emission, the time of the testing, the frequency of the various components, etc. 

[0012] These data then reside in the technology specific program completed that has just 
been run. Based on Block 2 of Figure 1, there is an extraction or classification of specific 
data elements as features. This process is described as follows. The data elements are now 
features selected by the professional and based on his/her judgment. A data element might be 
the signal-to-noise ratio of the otoacoustic emission at 1600 Hz. Another data element might 
be the number of quiet sweeps that was presented. All these are elements that could be used 
in an analysis of the particular test. A data element is a potential feature. There are data 
elements that might not be used as features by a particular professional because he or she does 
not consider them to be critical to the analysis. Another professional might use that particular 
data element. The various features that the professional determines are then identified to 
develop rules for rule development. This is shown in Block 3. This is the rule development 
of EVA that is based on the professional's decisions. 

[0013] The output of EVA after the professional has made his decisions on rule 
development and after it has been implemented via the C++ programming language, is a 
decision about the test that was completed on a particular patient. That decision could be that 
the test was "technically inadequate" and needed to be redone. It could be that the test was a 
"pass", it could be that the test was a "fail", and that additional testing was needed. It might 
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be that in a particular embodiment, if one looked at cardiac function, no additional testing was 
needed based on the results of the decision tree rules that were implemented by EVA. A 
professional might decide to use a morphologic analysis of a waveform to determine if a 
response was present in the waveform. This might produce the decision that a patient had an 
abnormal brain stem function. That could be an additional implementation of a rule by EVA. 

[0014] Fig. 2 is a series of Blocks showing the user rule selection. The first block functions 
to determine classification levels. The embodiment of Block 4 in Figure 2 is shown in detail 
in Figure 5. In the computer screen of Fig. 5, the interpretive assistant parameters for the 
analysis decision tree are set. It is the analysis decision tree in which the various 
U classification levels are determined. The classification levels are a technical fail level, a pass 
»S level, and another technical fail level, and the issues are whether the criteria are met, whether 
W the criteria are sufficient for a pass, necessary for a pass or contributing to a pass. The issue 
U with a technical fail level is whether the technical criteria for "refer" are met or not. Note in 
H Figure 6 there is a computer screen showing the technical minimums for analysis. In Figure 7 
3 there is the sufficient criteria shown the criteria sufficient for pass, and this is the specific 

ty embodiment for the ILO Otodynamics Transient Evoked Otoacoustic Emission. In Figure 8 
® there is shown a computer screen depicting the necessary criteria for pass, and in Figure 9 
O there is shown the contributing criteria for a pass level, necessary but contributing. In Figure 
m 10 there is shown the technical minimums for a refer result. A refer in this case means the 

patient is sent for additional evaluation. In the right hand corner of Figure 5, the directions to 
the professional are shown suggesting how to sub-program EVA and make the decision tree 
work for that professional. Again, it is the professional's judgments that are being 
implemented, not generic decisions. It is the professional who is doing the testing, who is 
responsible for the testing, and who is responsible for the interpretation of the results. The 
rationale behind EVA is to leverage the expertise of the professional to allow that person to 
conduct more testing in a high quality and cost efficient manner and to improve patient care 
through automation. 
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[0015] Referring again to Block 4 - Determine Classification Levels - the foregoing 
illustrates the manner in which this step has been accomplished. The professional would 
continue at the first level (Block 5). The first level is the first evaluative criteria that the 
professional has determined will be important in the decision making criteria. This indicates a 
very higherarchical interpretive assistant. The first level in the specific embodiment is the 
technical minimum requirement for a test to be analyzed to evaluate it. 

[0016) The technical minimums utilized in analysis are shown in Figure 6. Note that the 
professional makes judgments and the judgments are related to various criteria that are pulled 
out and extracted from the particular technology utilized in obtaining data from the patient. It 

I* could be the ILO88, it could be the GSI60 Distortion Product, it could be an auditory brain 

Q 

□ stem response obtained by the by Bio-Logics equipment, it could be the Nicolet auditory 
J| brainstem response equipment. It could also be the EMG equipment produced by Nicolet or 
!>* Bio-Logics. In this case the implementation is the ILO88. The first decision that the 
VI professional needs to make is: what is the minimum number of quiet sweeps that must be 

collected for a test to be analyzed further. The professional can make that decision and 
yj increase or decrease the value. In this case, the minimum number of quiet sweeps was set at 

60 as the standard. If this were an auditory brain stem response, the minimum number of 

O quiet sweeps might be set at 1 000 or 2000 sweeps. The technical minimums for analysis 

jfO 

allow the professional to assess other features: the maximum number of quiet sweeps, a 
percentage of quiet sweeps, minimum and maximum, the lowest stimulus intensity that would 
be allowed as well as the highest stimulus intensity that would be allowed. Note that the 
second selected technical minimum for analysis is that the maximum peak stimulus cannot 
exceed 85 dB. Only two values in this level were selected in the illustrated example: a 
minimum number of quiet sweeps and a maximum peak stimulus. The user (or the 
professional) involved had many other choices available. In Block 6 of Figure 2 the "Rule 
Values" for this level are obtained. The rule values would be the minimum number of quiet 
sweeps of 60 and the maximum peak stimulus of 85 dB. 
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[0017] The next query in Block 7 of Figure 2 is: is there another level to examine? If not, 
the selected rules are saved and processing continues. If the result of Block 7 is in the 
affirmative, the user rule values for this level are obtained. In the interpretive assistant 
parameters of Figure 5, the next level is to detail the sufficient criteria necessary for a test to 
be considered a pass for the decision of the professional to make a test, the pass test. This is 
shown in Figure 7. The entries of Figure 7 set the sufficient criteria for a pass. The rules that 
the professional would make in this case are: what is the whole wave response in dB. What is 
the whole wave correlation? What is the net response at 800 Hz, at 1600 Hz, at 2400 Hz, at 
3200 Hz and at 4000 Hz? Basically, the professional would define his necessary results for 
the test to be a pass. The selected entries of Figure 7 are thus the second level that would 

f>* need to be evaluated by EVA. 

Q 
C3 

CO [0018] The next inquiry in the User Rule Selection of Figure 2 is: is there another level? If 
1,5. not, EVA saves the rules selected thus far, and then makes the decision based on what has 
P been done. If there is another level, processing goes back and obtains the rules for this level. 
■ In this case, there is a necessary criteria for a pass. What is sufficient, what is necessary? The 

p necessary criteria that the professional in this example has made are shown in Figure 8. There 
© are illustrated seven necessary criteria that have been delineated, and two that are selected by 
O the user as being absolutely required. That is, the whole wave correlation between, in this 
N case, the ILO88 two waveforms that are being collected, must be fifty percent or better. Note 
also that the signal-to-noise ratio, (net response 4000 Hz), has to be at least 6 dB. That is a 
requirement for the test to be considered a pass. The question again in Block 7 of Figure 2 is: 
is there another level? If not, then EVA saves selected user rules; if yes as shown in Block 8, 
EVA proceeds to the next level shown in Figure 9. 

[0019] The next level is "contributing criteria" for the test to be considered a pass. In the 
specific embodiment of the IL088 Quick Screen Transient Otoacoustic Emission test, there is 
utilized the quick screen testing mode. There are basically another seven criteria that are 
contributing to a pass. In this example, the professional involved has selected three that 
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contribute. Note that the net response (again, this is signal to noise ratio) at 1600 Hz has to be 
at least 3 dB, the net response at 2400 Hz has to be at least 3 dB, and the net response at 3200 
Hz has to be at least 6 dB. Note also that in terms of contributing criteria, two of those three 
are required for this to be contributing criteria. The next inquiry is whether there is another 
level. If not, the rules are saved, if yes, processing returns to look again. In this example, 
there is one more level to consider, which is shown in Figure 10. 

[0020] Figure 1 0 is the technical minimum criteria for a professional to decide whether the 
test is either a refer or a fail. A "refer" means to refer a patient for additional assessment. 
There are eight criteria that are being examined, i.e., that the user or professional can consider 
U - the minimum number of quiet sweeps, the maximum number of quiet sweeps, etc. Note that 
S in this example the professional has made two decisions, that the minimum stimulus intensity 
© (the trough stimulus) must be no lower than 70 dB, and that the minimum trough percent 
|I stimulus stability has to be 60 percent. Either of these two criteria are enough to classify this 
fi test as a technical fail. In other words, if the overall stimulus is less than 70 dB, the test is not 
s a fail or a refer, it becomes a technical fail, or a technically inadequate test. Similarly, if the 

y stimulus stability (and that refers specifically to whether the probe in the baby' s ear is inserted 
F? firmly) is not at least 60, then the test result is interpreted as a technically inadequate test (or a 

0 technical fail) rather than a true fail. What that EVA offers the screener, or the tester, or the 

1 y technician at the bedside is immediate feedback, to "do it over", because it is not a technically 

acceptable test. This "do it over - it is not technically acceptable" will actually improve 
patient care because the technician has a chance to correct an error before the patient has left, 
before money has been spent, and a retest of something that was conducted poorly the first 
time is necessary. This specific piece of information allows the screener to self correct at a 
point when it can still impact the quality of care for the patient. 

[0021] Is there another level? If not, these rules are saved (Block 8 of Figure 2). The user 
has made selections on the selected rules, on the decision criteria. The user can be sitting in 
an office, or setting up EVA to implement his/her decisions. Once the user has completed this 
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step, it is these decisions that will be implemented in the nursery, the laboratory, to wherever 
the test is going to be performed by whoever is going to perform the test. When the 
technician begins to conduct a test on a real patient, these are the rules that will be 
implemented, and the rules that the technician will automatically follow. EVA will provide 
the technician with immediate feedback as to what the professional wanted. Even if a test is 
conducted at 2:00 in the morning when the professional is not present, his or her criteria will 
be implemented consistently and repeatedly. Screener fatigue will not enter, errors won't 
happen because of inadvertent oversight. The professional's rules are automatically applied 
day in and day out. 

[0022] Following the actual testing, whether diagnostic test or screening, the results are 
displayed for the benefit of the screener. If the results are a pass and a refer, a report is 
immediately generated and this report contains, again, the words of the professional. In 
Figures 13, 14, and 15, the professional chooses the language. This is another one of the 
levels that the professional will set up: i.e., report generation. The report will be printed, 
automatically, at 2:00 in the morning immediately following the test. The test results will be 
automatically extracted from the technology specific electronic representation, and that 
information will be placed in the report. So once again the screener cannot make an error and 
print or otherwise insert an incorrect letter into a patient record. EVA goes in, looks at the 
test results, makes the decision in real time, and places the results in the letter that will be 
generated promptly. One more level of potential error in medical care is eliminated by the 
automatic decision and application of the decision and generation of reports. 

[0023] Figure 3 is a diagram illustrating the application of the rules. Block 9 in Figure 3 is 
"data submitted". This refers to the extraction of data from the electronic technology or 
electronic representation. Data is submitted (Block 10) and the user rules are retrieved for 
each level (Block 1 1). For each rule in a level (Block 12) the question is asked, does the data 
satisfy the rule (Block 13)? In Figure 6 there are illustrated technical minimums for analysis. 
The minimum number of quiet sweeps has been selected as 60. The maximum peak stimulus 
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is less than 85dB. At this level then, there are two rules in the level. The data obtained from 
the patient is examined by EVA to see if it satisfies each of these two rules. "Does the data 
satisfy the rule" is the question posed in Block 13. In Figure 3 (Block 14), EVA "asks" 
whether another rule is required? Following a test is completion, the technician retrieves the 
EVA test result to determine the next steps for a particular patient. 

[0024] In this example, there are other levels. The sufficient criteria for a pass is shown in 
Figure 7. The necessary criteria for a pass is shown in Figure 8. We note that the whole 
wave correlation must be 50% according to the selected rules shown in Figure 8. Note that at 
4,000 Hz, the signal of the emission must exceed the noise level of the emission by 6 dB. 
That is another required rule. If another rule is not required, the next question is: is another 
level required? Whole wave correlation must be 50%. That's one rule. Is another rule 
required, yes. The net response must be a 6 dB signal to noise ratio. Within a level, there are 
these two rules in this example. 

[0025] The next question is, is another level required? In this example, there are the 
contributing criteria for a pass. The answer is yes, another level is required. This is shown in 
Block 15 Figure 3. In this example are contributing criteria for pass, and there are three rules 
out of seven in this level. There are three rules out of seven that the professional has set for 
contributing criteria (Figure 9). Only two of those criteria or two of those rules must be 
implemented or required for the contributing criteria to be met. If a net response or a signal- 
to-noise ratio at 1600 Hz of 3dB is met, the 3dB criteria at 2400 Hz need not be met if the 
3200 Hz, 6 dB signal to noise criteria is met. 

[0026] Is another level required (Block 1 5)? This is shown in Figure 1 0 where there are two 
technical minimums marked or decided upon by the professional in this example. One 
minimum is the minimum trough stimulus. The other technical minimum is the percent 
stimulus stability. Either of these minimums is sufficient to classify the result as the tech fail. 
It is noted that the minimum criterion required to classify as a tech fail is one. The 
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professional establishing the rules could have changed that number to two if he/she felt it was 
correct/needed. 

[0027] Block 1 6 of Figure 3 represents the decision. At this point in the processing, all 
levels and all rules of each level have been assessed. In the example, no more rules are 
required and no more levels are available to evaluate. EVA returns the classification of the 
test results based on the professional's interpretive criteria. The classification is considered 
the result. From the result a report is generated to the referring physician or referring 
clinician. Classification is pass, fail or refer, or a technically inadequate test. Classification 
might be refer for additional diagnostic cardiac testing. Classification might be conduct 
another test. Classification can be basically whatever the professional decides is the next step, 
based on the rules that he/she is generating. Figure 12 is an example of a results report. 
Figures 13, 14 and 15 are other example reports. Figure 13 is a report to a physician showing 
that the baby in this case born on March 14, 1997, did not pass the test in the right ear or the 
left ear, that is, the baby "referred" in both ears. The words in the letter are the words that the 
professional determines to be acceptable. The reports can be modified by another 
professional. Figure 14 is an example letter to a physician where the results of the letter are a 
pass in both the right ear and the left ear on the infant. Figure 15 shows a test result of pass in 
the right ear and refer in the left ear. Again, the words of the report are generated by the 
clinician of record. Note there is no letter for a technically inadequate test, although such a 
message can be generated. In general, technically inadequate results are required to be 
conducted again of this example. 

[0028] The specific embodiment of Figure 4 constitutes three elements. The first element is 
that the values saved by the ILO88 Otoacoustic emissions equipment (manufactured by 
Otoacoustic Dynamics) are read from the ILO generated data file. These elements are read 
and then are named. Specific values are named for each level and for each rule in a level. For 
the second element, the user selects the values, the ranges and the features. Finally, the data 
are retrieved from the ILO data file and the macro, the software, i.e., EVA retrieves the user 
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rules and applies them to data for classification. Note then that the software code is the 
implementation of element 3. The software code can be referred to in Figure 11, and is the 
specific embodiment of the third element where the macro retrieves the user rules and applies 
them to classification. 

[0029] Through the utilization of the invention patient care is improved because feedback is 
provided to the technician immediately. The technician can learn immediately from his/her 
errors and alter the outcome before the patient has left the premises. This can eliminate an 
inadequate and costly test session. 

^* [0030] In summary, this software system operates for the caregiver at the bedside by 

S3 

O reducing errors. The software leverages the costly professional's time and energy. It 

CO 

<, 1. facilitates prompt and accurate patient care through rule governed decision analysis. When 

I* widely implemented, it will reduce health costs. 
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